ANALYTIC SCORING OF TOEFL®CBT ESSAYS: SCORES FROM HUMANS ANDE-RATER®
نویسندگان
چکیده
منابع مشابه
Analytic Scoring of TOEFL® CBT Essays: Scores From Humans and E-rater
The main purpose of the study was to investigate the distinctness and reliability of analytic (or multitrait) rating dimensions and their relationships to holistic scores and e-rater essay feature variables in the context of the TOEFL computer-based test (CBT) writing assessment. Data analyzed in the study were analytic and holistic essay scores provided by human raters and essay feature variab...
متن کاملConstruct Validity of e-rater® in Scoring TOEFL® Essays
This study examined the construct validity of the e-rater automated essay scoring engine as an alternative to human scoring in the context of TOEFL essay writing. Analyses were based on a sample of students who repeated the TOEFL within a short time period. Two e-rater scores were investigated in this study, the first based on optimally predicting the human essay score and the second based on e...
متن کاملOn the Automatic Scoring of Handwritten Essays
Automating the task of scoring short handwritten student essays is considered. The goal is to assign scores which are comparable to those of human scorers by coupling two AI technologies: optical handwriting recognition and automated essay scoring. The test-bed is that of essays written by children in reading comprehension tests. The process involves several image-level operations: removal of p...
متن کاملScoring Essays Automatically Using Surface Features
Surface features of essays include nonlinguistic characteristics such as total number of words per essay (essay length), sentence length, and word length as well as linguistic characteristics such as the total number of grammatical errors, the types of grammatical errors, or the kinds of grammatical constructions (e.g., passive or active) that appear in an essay. This study examines the feasibi...
متن کاملDeveloping an Analytic Scale for Scoring EFL Descriptive Writing
English language practitioners have long relied on intuition-based scales for rating EFL/ESL writing. As these scales lack an empirical basis, the scores they generate tend to be unreliable, which results in invalid interpretations. Given the significance of the genre of description and the fact that the relevant literature does not introduce any data-based analytic scales for rating EFL descri...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: ETS Research Report Series
سال: 2008
ISSN: 2330-8516
DOI: 10.1002/j.2333-8504.2008.tb02087.x